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ABSTRACT 

Using Glass's meta-analysis, of which "effect size" 
is the fundamental measure, 135 research studies on Ausubel's advance 
organizer theory were reviewed to determine its effect on learning 
and retention. Variables, such as grade level, subject area, 
organizer presentation mode^ and ability level were also examined. Ir 
most of these studies advance organizers are shown tc have a 
facilitative effect on learning and retention. Advance organizer 
effect on retention increases with time in relation to the control 
group* Learning is shDwn to be more pronounced in college and special 
education subjects than in primary or secondary school subjects, 
while primary school subjects show a greater retention increase. 
Within subject areas, average effect size of the advance organizer or. 
learning and retention is positive, especially in the social sciences 
for learning and in the physical sciences for retertion. For subjects 
of high ability, the average effect size exceeds that for low ability 
subjects. Aural mode advance organizer studies show a greater average 
effect size than written moj^e, especially for college level subjects. 
(M H) 
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Ovezr-the years, liossens of studies aave appeared in the liter®- 
tnire claiming to have tested an AusciWiean organizer (Ausubel, I963} 
one e;3^sriinental sstting or anoth^. Many of these stadias ha.yfB 
r^^ld ed sesmingly cortradi ctory resui^as. In a variety of studies 
.itaisuT^el, I96O; Scandsra end Weils, ..^^T?; Allen, I969), tis uise of 
mxx advacuDe orgaii3,ser tas been snown : produce a statistically sig- 
nificant Increase ir laarrring ami r "^f^on. Otter studies (Baumaicu. 
v^lass anr. Haxrinj^on ^ 1965^? Barr=, lyri; Feller, 1973) 1 have f ail«i 

A xrzy^iaas reviw cf idae lltEra^^are Ijy Barnes and Clawson '1975) 
asRd a varS-ai«£ of tae "^votin^ tBtSEii^as'' in which 32 advan?T»>» organizer 
saadies mess*. ilassifJ«i intc ^ those -PiiTi^^ng statistically significant 
r.. i- itF :and :3iiose:^zming stsdsticaO^ nonsignificant resui-ss. k 
r. c TTssi gntn crr rr t resiulr^syas invariably interpreted t)y Barnes ar^ CiaMison 
^-^ a finding againstt :nie fadlitative gf?ect of the advanoe assanjarer. 
Hci-signif icant stau'dj^w* outnumbering significant ones in ther reviaw, 
Bffinies and Clawson concluded that " . , . advance organizers as pr ^^ ^ently 
cvjoastructed, genertsQJj do not facilitate learning." 

The authors r3f *1nis pa^er are of the opinion that the lack of ^ 
attatistically sLgoi£Lxaxit finding in favor of the advance organizesr 
trssatment grougp iiu jmy studies does not necessarily indicate that the 
adwance organizer 3»i no facilitative ^i'fect. Rather, failure to ^Mcain 
st itistically slp^lCcant differences among treatment groups in man^r 
si^udies may 'be dmse -35 a variety of other causes (small numlDer of sutb* 
OPrtrts, short duracim of treatment, low reliability of msausuring instm- 



ment^M etc-.) as w£Z. as a gencine lack of advance organizer effect . 

A lua^or prcfelaE: with tte voting technique used Isy Barnes and 
ClaawBsn ia that it, toes not take into account any positive treatasent 
sf f lict wh£ch fails i=D reach tne criteria of statistical signif iowice . 
Indeed, the opposit^t is true. Studies showing positive i yet statistl- 
caVs nonBignificani;:. effects are grouped together with those stiadles 
ain^irlng sta.'tisti-caliy significant or nonsignificant negative ef&cts . 

Tmolts of ^ rs^vlew of this type are cleaoiy biased against a 
f»vor^e finding. 

Glass (1978) jETOBOsed a tKsnrique that he termfid Msta-Analysis 
b whlcii traataent eSlBcts may m 3>iantified, standacdiaBd, and compared 
acxoBs srudies. ftmdaanentai. JMBsure in Meta-Anaaapsis is the effect 

slTO" statistic (E* S..\ . The f naanla suggested t^y r.\:5«g is: 

c 

Wheret = Msc: c£ Treatment Group 

= KesL of Control Group 
S»S)»^ = Siaaaard Desriation of Stontrol Group. 

Tim ^f£lect sl^t is a standardized measure of treatment effect 

wfcMch mas "be used to describe the res;ilts of a single study or averaged 

AQpne iwwal studies of similar type to provide a composite figure. 

WirtaliLy absent ±a Glass's technique is the concept of a statistical test 

fear FTgrfTtTgin ce of the effect size. All effect sizes 1 regardless of 

■agnSaaiiB, are worthy in their own right. In this way, the bias of the 

voting -taeamique is avoided and the detection of small, but consistent 

txeataezrt effects is made possible across studies. 
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METHOD 

The reseaorch literature reviewed for this paper consisted of 
approxiinately I70 published as well as unpublished advance organizer 
studies, including 76 doctoral dissertations, covering the period from 
i960 to 1979. Not all of these studies were unique, e.g., some disser- 
tation studies were later presented at national conferences or published 
as journal articles. Whenever seversil references to the saiiie study were 
obtained, all were examined, and the one containing the most experimental 
information selected for review. In this respect, dissertations were 
usually the most profitable and journal aorticles the least. In addi- 
tion, twelve references were not obtainable Ify the authors for review 
maJtLng the total number of studies reviewed for this paper 135. 

In each of the studies reviewed, the most important feature con- 
sidered was the magnitude of the effect of the advance organizer on 
learning and retention. Following Glass's suggestions, this magnitude 
was expressed in terms of the effect size statistic (E. S.). In this 
way, the I35 studies reviewed yielded 110 effect sizes for learning 
and 50 effect sizes for retention (most studies reviewed did not 
attempt to measure retention) . 

Subsets of these studies were selected and their effect sizes 
averaged to examine the effect of advance organizers on learning and 
retention. In addition, possible influencing variables such as grade 
level, subject area studied, organizer presentation mode, and subject 
ability level were examined in a similar manner. 

* 

A complete Bibliograpliy of these studies can be obtained upon 
request from the authors. 
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In some of the studies reviewed, effect size**- * ^ icrpossible to 
compute because these research reports lacked tiece^^tsr mesais and 
standard deviations. A few studies ccmtained iii^v"** tlai*r que treatment 
group or contstEffid multiple eocperimentaJL situat:<aniB ^nd^ ^irssrefoire, 
yielded more tsan one effect size. Of-zbe total, jjrk^bra: rT. gmrliTP*^ 
yielding leaocn±ng effect sizes, sixteen prodac©:' than one effect 
size. For retention studies, eleven prcsiucedimu" ' effect sizes. 

BESULTS 

The average effect size for advance organ3J«»fi on leJErning and 
retention is shown in Table 1. In the ovenrij©lju.u.4g aajarity of studies 
reviewed, knowledge acquisition was measu3:ed-iJim0flA*bi^ after subject 
completion of the material to be learned. Far 1:]^ iMjjpoTOS of this 
review, all studies in which a measure of knoiCi.- cquisition was 

taien within 24 hours after completion of mater ^ combined to 
examine the effect of the advance organizer on - If two or 

more measures of knowledge acquisition were tafc*: ^M\sm 24- hours, only 
the first was used. Subsequent measures (more 2k hiours) of subject 

knowledge were defined as retention. 

Insert Table 1 He» 
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The data presented in Table 1 snow advance orgsranizers to have a 



The standard error of the mean is included in allteables presented 
solely to provide the reader with a Reeling for tfei variation of the 
effect size statistic. It is not the intention cff-the authors to 
test the statistical significance of the effect siae. 
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j^dlitative efilact on learning and retention in the average study 
zreviewed. Smith and Glass (1197^), assuming a normal distribution of 
subject scores, iaave praposesi tise followiBg interpretation for the 
average effect si:ze: "The a-roissE^ study showed a .68 standard devia- 
tion (E. S.) superiority of rrs trBate.4 gro u p over the control group. 
Thus, the average client receiviixig thea apy/ was better off than 75 per- 
cent of the imtr^ed controls."' UkIu*' tne Smith and 51ass inter- 
pretation, the mean effect siae 5nr \e -srrance organizer on learning 
( .21) would indicate that the arora^* sutject receiving the advance 
organizer treatment perfomed bett^ than 58 percent of the control 
group subjects. A similar stateioart can be made for the aveirage effect 
size at each retention interval .saown in Table 1. Interestingly, the 
retention data show the advance argaoizer effect to increase with time 
in relation to the control grccip. It should be noted, however, that the 
majority of studies reviewed used identical instruments to measure both 
learning and retention. 

To examine the influence grade level on learning and retention, 
advance organizer studies were regrouped into four categories: college, 
secondary, primary, and special.- education. Table 2 shows the aveirage 
effect size for advance organiaaers on learning and retention when 
classified by grsuie level. 



Insem. Table 2 Here 



The average effect size for ^studies using college and special 
education subjects can be seen to be greater than that of studies 
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earploying secondary or primary school suQn(tel3^ . in studie^^. of re- 
ttfrtdon, however, this situation is reverwdnith pcrijn^ school suV 
Jects. showing the Isrgest average effect sis« Whereas Taixie 1 seemed 
tz: ir±icate an average effect size increaa^ far all subject at longer 
iTs-lAsiiLLon intervals., it can "be seen in TaEsr 2 that this erfect size 
imszaea^in retention is most pronounced ±cr:^:he Trcimary g»des, smaller 
at -zh^ »:ondary level, and non-existant at rrhe college IctsI, 

'TaSfle 3 shows the effect of the advance t)rgaiiizer on ^gam^ng and 
reten ion when studies are classified Ify suoject area -fceugirt. In this 
table-, srudies are divided into four content areas: MstheKtics (sta- 
tistics, algebra, trigonometry, pl^sics). Physical Sciences (chemistry, 
geol , metallurgy, astronomy). Biological Sciences (plairt and animal 
biol microbiology, ecology), and Social Sciences (religion, psy- 
cholco^, geograpliy, economics, civics, art, language). 



Insert Table 3 Here 



Within all subject areas studied, the average effect size of the 
advance organizer on learning and retention was positive. In learning 
studies, the largest average effect size was in the Social Sciences, 
while in retention studies, the Plxysical Sciences showed the largest 
average effect size. In retention studies. Mathematics, Pi^jrsical 
Sciences and Biological Sciences all showed an increased average effect 
size, while the Social Sciences declined. 

The interaction of the advance organizer with subject ability 
is shown in Table Because of the small number of studies examining 
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subject ability and retentloiL.. t?iis table loresents the average effect 
sizes for learning studies OE=y. 

TifflBrb Table 4 Hesre 



Although it is the imprMsioiL of fiiany researchers that advance 
organizers should be most ef¥«£2fcive with subjects of low ability, this 
conclusion is not supported -the data. Table 4 shows that subjects 
who were defined as high abiillisy had an average effect size almost 
twice that of low ability su:bjects. The reaoer should keep in mind, 
however, that there is a gneat disparity amocig studies in their opera- 
tional definitions of high, middle and low aMlity. 

In the great majority of siadies reviewed, advance organizers were 
presented to the subject in written form. Subjects were required to 
first read the advance organizer passage then complete the material 
to be learned. Some studies have attemjl.^^ to deviate from this pattern 
by presenting the advance organiarer to the subject in other than written 
form. Table 5 shows the average effect size of the advance organizer 
on learning when studies are classified into written and aural advance 
organizer presentation modes. 

The category of aural presentation contains four studies not 
exclusively aural. In one study the subjects read the advance organizer 
passage while listening to the instructor read it aloud and in three 
others, an audio- visual (slide projector or movie) presentation cf 
the advance organizer was used. Studies varying organizer presentation 
mode as well as measuring retention were so few in number that they are 



9 



8 



not presented in Tatle 5. 



Insert Table 5 Here 



Table 5 shows the average effect size for aural mode advance 
organizer studies to be twice that of written mode advance organizer 
studies. In an attempt to explore this relationship further, aural 
mode advance organizer studies were classified Ijy grade level. The 
results are shown in Table 6. 



Insert Table 6 Here 



For college level subjects, an aural mode of advance organizer 
presentation produces an average effect size approximately three times 
that of the written mode. For primary level subjects, the average 
effect size doubled. Only secondary level subjects showed a decrease 
in average effect size for aural mode advance organizer presentation. 

DISCUSSION 

Barnes and Clawson (1975) concluded their review of advance 
organizer research with several recommendations for further study. 
Four of these have been addressed in part \fy this paper. 

1. "Studies should be conducted to determine the long-term 

effects of advance organizers." 

Long-term effect studies of advance organizers are few in 
number. No study reviewed in this paper measured subject retention 

ERIC 



longer than fifteen weeks after learning. However i a great number 
of studies have measured subject retention within the first four weeks 
after learni n g. These studies show a trend across time for the effect 
size to increase rather than decay. This would seem to indicate a 
permanent advantage stemming from the advance organizer treatm^t 
rather than a short teim "waaaa-up" effect. 

2. "Studies should be conducted with students of high ability- 
provided that the organizers are operationally defined and that 
the studies last for more than ten days." 

Barnes and Clawson make this recommendation based on a finding 
of "inconclusive" results for the effect of advance organizers on 
high ability subjects. The data presented in this paper indicate 
advance organizers to be effective with subjects of all ability 
levels and most effective with high ability subjects. This is basically 
in agreement with Barnes and Clawson 's three significant findings versus 
four nonsignificant findings for studies using high ability subjects. 

3. "Studies should be conducted at all grade levels . . . (to) 
lead to an eventual isolation of age or grade level as a signifi- 
cant variable." 

The results of this review show grade level not only to be an 
influencing variable on leaoming and retention, but also to interact 
with the presentation mode of the advance organizer. 

4. "Studies using a wide variety of nonwrltten advance organizers 
that are operationally defined and constructed according to general 
criteria espoused by Ausubel should be conducted." 

Although studies utilizing games, visual, and graphic advance 
organizers were too few in number to be studied by a meta-analytic 
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revieK, aural presentation studies appeared qtiite frequently and on 
the average show a much greater effect size than studies using only 
a mitten presentation mode for the advance organizer. 

CONCLUSION 

This review cannot answer all of the questions that have arisen 
concerning the use of advance organizers in the facilitation of 
learning and retention. Many of these questions as well as a numlDer of 
recommendations for further research have been excellently summarized 
Lawton and Wanska (197?) and will not he repeated here. Rather, it 
is the intent of the authors that this paper consolidate many of the 
established research findings concerning the facilitative effect of 
advance organizers on learning and retention called into question 
the Barnes and Clawson review. Hopefully, the authors of this paper 
have succeeded and, thereby, freed future researchers to investigate 
many of the still unanswered questions concerning advance organizers. 



ERIC 



12 



BEfERENCES 



Allen, D.I. Some effects of advance organizers and level of retention 
of wdtten social studies material. (Doctoral dissertation, 
Uni.verslt3r of California, I969) . 

Ausubel, D.P. The use of advance orgajiizers in the learning and retention 
of meaningful verbal material. Journal of Educationa l Psychology, 
i960, ^, 267-272. ^ ^ ^ 

Ausubel. D.P. The -nRvrshnl ncrv n-P m 00 rt rt it-Pi 

Grune & Stratton, I963. 

Barnes, B.R., & Clawson, E.V. Do advance organisers facilitate learning 
Jlecommendations for further iresearch based on an analysis of 32 
studies. Review of Educational Research . 1975, it^i 637-659. 

Barron, R.R. The effe cts of advance organizers u-pon the rece-ption of 
learning and retention of general science content (Final report). 
Department of Health, Education, and Welfare, Projecrt No. IB-O3O; 
Grant No. 0BG-2-'710030, November, 1971. (ERIC Document Reproducrtion 
Service No. ED 06I 55k). 

Bauman, D.J., Glass, G.V., & Harrington, S.A. The effects of the -position 
of an org anizer on learning meaningful verbal materials (Research 
Paper No. 24). Laboratory of Educational Research, University of 
Colorado, I969. 

Feller, W.A. The effects of two types of advance organizers and two 
types of spaced questions on the ability of a selected group of 
tenth grade biology students to recall, comprehend, and apply 
facts from written science material. (Doctoral dissertation. 
Temple University, 1973). Dissertation Abstracts International . 
197^1 2kf I766A. (University Microfiljos No. 73-33, 188). 

Glass, G.V. Integrating findings: The meta-analysis of research. 
Review of Research in Education , 1978. 

Lawton, J.T., & Wanska, S.K. Advance organizers as a teaching stra- 
■tegyi a reply to Barnes and Clawson. Review of Educati onal Re- 
search . I977f iZ, 233-2^. ' 

Scandura, J.M. & Wells, H.N. Advance organizers in learning abstract 

mathematics. American Educational Research Journal . 1967, 4, 295-301. 

Smith, M.L. & Glass, G.V. Meta-Analysis of psychotherapy outcome studies. 
• American Psychologist . 1977, 752-760. 

11 

ERiC 13 



TABLE 1 



Mean and Staadard Error of Effect Size for 
Advance Organizers on Learning and Retention 





Learning 


Retention 




0-1 Day 


2-6 Days 


7 Days 


8-20 Days 


21 Days 


22+ Days 


Number of 








Effect Slsses 


110 


8 


17 


8 


9 


8 


Mean 


.21 


.19 


.20 


.23 


.30 


.38 


Standaxd 














Error 


.04 


.15 


.10 


.16 


.11 


.16 



TABLE 2 



Mean and Standard Error of Effect Size for Advance Organizers on 
Learning and Retention When Studies Are Classified By Grade Level 





Learning 


Numlaer of 
Effect Sizes 


CoUege 
CCrad & Under) 

40 


Secondary 
(Grades 9 - 12) 

36 


Primary 
(Grades 3- 

30 


8) 


Special 
Education 


Mean 


.26 


.17 


.17 




.28 


Standard 
Error 


.09 


.06 


.08 




.12 




Retention 


Nuialser of 
Effect Sizes 


College 
(Grad & Under) 

20 


Secondary 
(Grades 9 - 12) 

20 


Primary 
(Grades 3- 

10 


8) 


Special 
Education 

0 


Mean 


.21 


.26 


.33 




0 


Standard 
Error 


.08 


.10 


.14 




0 
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TABLE 3 



Meaai and Standard Error of Effect Size for Advance Organizers on 
Learning and Retention When Studies Are Classified By Subject Area 





Learning 




Mathematics 


Physical 
Sciences 


Biological 
Sciences 


Social 
Sciences 


Number of 
Effect Sizes 




32 


21 


33 


Mean 


.10 


.15 


.11 


.3^ 


Standard 
Error 


.09 


.06 


• 07 


.10 




Retention 




Mathematics 


Physical 
Sciences 


Biological 
Sciences 


Social 
Sciences 


Number of 
Effect Sizes 


13 


8 


15 


14 


Mean 


.17 


.50 


.18 


.26 


Standard 
Error 


.11 


.18 


.10 


.09 



TABLE 4 



Mean and Standard Etror of Effect Size for Advance Organizers on 
Learning When Studies Are Classified By Subject Ability 





Ability Level 




High 


Middle 


Low 


Number of 






Effect Sizes 


26 


9 


29 


Mean 


.23 


.08 


.13 


Standaxd 








Error 


.16 


.32 


.09 
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TABLE 5 



Mean and Standard Error of Effect Size for Advance Organizers on 
Learning When Studies Are Classified By Organizer Presentation Mode 





Presentation Mode 




Written 


Auxal 


Number of 






Effect Sizes 


89 


21 




-17 


.37 


Standard 






Etror 


.04 


.14 



TABLE 6 



Mean and Standard Error of Effect Size for Aural Advance Organizers on 
Learning When Studies Are Classified By Grade Level 





Grade Level 


Number of 
Effect Sizes 


College 
(Grad & Under) 

6 


Secondazy 
(Grades 9 - 12) 

6 


Primary 
(Grades 3-8) 

8 


Special 
Education 

1 


Mean 


.68 


.11 




.37 


Standard 
Error 


.^3 


.07 


.15 
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